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THE EDITORS SAY: 


A BOLD VENTURE — 
Statewide Coordination of Educational Research 


Caur ORNIA has embarked upon what may prove to be a great ad- 
vance in the improvement of current educational research. Statewide, an 
effort is being made to promote the coordination of such research. While 
it may take years to accomplish, the possibilities are so great (and the 
need is so apparent) that the time and effort required to reach the goal 
will be considered a sound investment. 


The move to coordinate research efforts in California got under way in 
1948 with the establishment of the State Advisory Council on Educational 
Research. Sponsored by the California Teachers Association, the personnel 
of the Council was selected to represent the various agencies that initiate 
and conduct educational research. Membership on the Advisory Council, 
therefore, includes persons from the colleges and universities, large city 
school systems, a county school department, the State Department of 
Education, the Association of School Administrators, and the California 
Teachers Association. Meetings are held four times a year. 


As might be expected, the Council spent much of its time the first year 
in exploring the possibilities of coordinating educational research. Ob- 
stacles and problems involved were thoroughly studied and discussed. 
As time passed, the conviction that coordination was both possible and 
desirable strengthened. But how to achieve it? Several ideas have been 
advanced. While it is too early to assess their worth, readers of this 
Journal may be interested in having a progress report. 


One of the first ideas proposed to stimulate coordination of research 
effort was the suggestion that a central clearing house somewhere in the 
state be established for the filing of research reports and materials. The 
State Advisory Council on Educational Research recommended that the 
logical center for such a clearing house should be the Research Depart- 
ment of the California Teachers Association. This led naturally to a 
follow-up in which all district and county school systems were contacted 
and asked to submit copies of their published studies. Likewise, the col- 
leges and universities were also solicited. During the past three years a 
sizeable file of California research studies has been developed and is now 
available in the Research Library of the new CTA Building in San 


Francisco. 


— Continued on Page 208 
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An Experiment In Democratic 


Methodology 


FRANCES Topp 
San Francisco Unified School District 


Tue aim of this study was to explore and test some teaching methods 
in physical education that gave promise of contributing to the educational 
objective of furthering democracy by translating democratic principles 
into democratic action on the playfield and in the gymnasium. 


The Setting: Physical Education 


Physical education has many innate advantages over many school sub- 
jects for implementing democratic experience. As the only school subject 
required of all students from kindergarten through junior college, physi- 
cal education affords excellent opportunites for continuing contact with 
the same group of children for a consecutive period of years. Play itself 
is a powerful motivator. The teacher on the playing field operates close 
to the biological frontier. He deals with human beings in action situations 
where strengths and weaknesses are displayed readily. The informality 
of the student-teacher relationship offers rich potentialities for effective 
guidance, and the playground and gymnasium are superb laboratories for 
studying the individual in action. 


The raw materials for optimum individual development are inherent 
in the very nature of physical education. But the outcomes of these poten- 
tials have varied widely throughout recorded history. Tribal ceremonies 
aiming to indoctrinate youth into adult citizenry were composed largely 
of dances and feats of skill. Ancient Greece and Sparta focused on sports 
and physical activities to implement their national philosophies. Rome 
scorned the ideals of Athenian culture and Spartan hardiness and Roman 
sports degenerated into corrupt spectacles which reflected decadence and 
debauchery. Germany, Russia, and Italy most successfully fostered totali- 
tarianism by planned use and political control of all physical education. 
The Olympic Games, UNESCO, the Pan American Congress on Physical 








Frances Todd is assistant head counselor and teacher of physical education at 
Balboa High School, San Francisco. She has taught in the San Francisco schools, 
except for a period of service with the American Red Cross during the last war, 
since 1934. Miss Todd received her doctorate at Stanford University in 1951. Her 
article is a digest of her dissertation. 
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Education, and the American Association for Health, Physical Education, 
and Recreation, are attempting to implement their purposes through capi- 
talizing on the universality of appeals of sports and dance. Thus the pot- 
ency and diversity of the roles which physical education has played and 
is playing in fostering ideologies leads to the observation that the methods 
used to develop the seemingly constant potentials of physical education 
are a vital variable. This study attempted to review methods that gave 
promise of democratic outcomes in physical education, and to try them 
out in high school classes. The results were measured sociometrically and 
empirically. 


Democratic Methods in Physical Education 


The essence of democratic methodology in physical education is the 
creation by the teacher of a favorable environment for pupil acquisition 
of democratic actions and behavior traits—the maintenance of a living 
laboratory for meaningful pupil participation in democratic practices. 
It is explicit environmental manipulation, thoughtful planning and re- 
planning to meet the exigencies of the ever-changing human relationships 
within the class, so that each individual, and the class as a whole, experi- 
ences, and knows that he is experiencing democracy in action. Teacher 
aims should include efforts to increase interaction through widespread 
participation in leadership and followership roles, to effect upward 
mobility and increase status of the unpopular, unaccepted, lonely and re- 
jected child, to improve physical and communicative skills, and to induce 
pupil cognizance of the democratic process. The following are cited as 
examples of physical education class management techniques that proved 
practical and worthwhile when used in girls’ classes in a large city high 
school with inadequate play space and classes averaging fifty pupils: 

1. The democratic process was discussed and by joint teacher-pupil planning 
and group process techniques the classes were conducted as laboratories of 
democracy. By reciprocal assumption of the expert and member roles the 
instructor and pupils shared responsibilities in accordance with their maturity 


and abilities, and within the framework of an authoritatively administered 
school. 


. To induce interaction, squads were set up by the instructor each six weeks, 
corresponding with the change of activity. Student preference for teammates 
was strictly adhered to, and student elected officers were chosen every three 
weeks, Opportunities were provided to further acquaintanceship through 
mixers, tournaments, etc. 


. Individual and group guidance techniques were used to foster upward mobil- 
ity, increase the status of the unchosen, unpopular and rejected child, and 
increase group cohesion. 


. Opportunities were provided to encourage self-direction, responsibility for 
one’s own actions, self and peer evaluation on the basis of merit only, recog: 
nition and empathy for individual differences, and competition in a frame- 
work of cooperation. Pupil-teacher joint evaluations were equally weighted in 
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determining the report card grade. 
5. Buzz sessions, sociodramas, and problem solving devices were used. 


Measurement of Democratic Methodology 


Some of the outcomes of democratic methodology were measured in 
three physical education classes during an eighteen-week semester, Socio- 
metric techniques, empirical observation documented by extensive anecdo- 
tal records and interpreted through intensive use of relevant background 
data about each pupil, and an anonymous student opinion questionnaire 
circulated at the end of the term, were the evaluative techniques used. 

The following sociometric tests' were given: 


1. Acquaintance volume tests: The purpose of these tests was to measure the 
increase in acquaintanceship in the classes during the term and thus parti- 
ally determine the extent of interaction. On the first and last days of the 
class each girl listed the classmates she knew by first and last names. 

. Functional choice tests: Three times during the term, the first and last days 
of class and halfway through the semester, the pupils submitted a confiden- 
tial list of more than five girls whom they would prefer as squad-mates 
for the ensuing activity unit. The students were also permitted to designate 
any classmates whom they did not wish to have on their squad. The purposes 
of these tests were: 

(a) To serve as the basis for squad assignments. 

(b) To locate quickly the highly chosen, isolated and rejected students and 
to determine clique patterns. 

(c) To determine changes in individual status and group cohesion. 

(d) To verify empirical observation of the nature of the needs of individuals 
and groups for guidance aimed at the improvement of interpersonal 
relationships. 


Findings 


1. Acquaintance Volume: In all three classes the average acquaint- 
ance volume per pupil almost doubled during the eighteen-week term. The 
gains for each class expressed in percentage of new acquaintances made 
during the term were: 50.4, 44.8, and 40.4, respectively. 

2. Upward Mobility or Increased Individual Status: Upward mobil- 
ity was experienced by 75% of the combined classes, downward mobility 
by 13%, and 12% evidenced no change in individual status. This was 
measured by Cook’s formula,’ using student choices as expressed in the 


* Adapted from James L. Moreno Who Shall Survive? Washington: Nervous and 
Mental Disease Publications, 1934. 


* Lloyd Cook, “Manual for Obtaining, Analyzing and Diagramming Sociometric 
Data.” College Study in Intergroup Relations, Wayne University, Detroit, Mich. 
(Mimeographed) 


197 





CALIFORNIA JOURNAL OF EDUCATIONAL RESEARCH Vol. Il, No. 5 


functional and choice tests: 


Total Choices minus Total Rejections : TC—TR 
Number minusl om = - N= 

3. Group Cohesion: a slight but measurable gain in the “we-feeling” 
or group cohesiveness was evidenced in these classes by slight termwise 
increases in Group Cohesion Scores, as measured by Cook’s formula,’ 
using the totals of the class’ choices and rejections as expressed in the 
functional choice tests. The formula follows: 


Total Choices Made in the Class minus Total Rejections Made in the Class 


Number (Number minus 1) 
or 





TC—TR 


—— “a. 


4. Rejects, Isolates, and Near Isolates: In the total group there was 
approximately a 60% decrease in the total number of rejections when the 
start and end of the term scores were compared. Of the original total of 
eight isolates and 27 near-isolates, there remained three isolates and eleven 
near-isolates on the last day of class. Rejects were girls specified as un- 
wanted as squad-mates by one or more of the class; isolates were unchosen 
pupils, and near-isolates were selected by their peers only once or twice. 
These choices and rejections were revealed in the functional choice tests. 


Student Evaluation of Democratic Methodology 


Many of the democratic experiences were new to most of the students 
in these classes, as the majority of their previous experiences in physical 
education were characterized by teacher-dominated planning and control. 
The pupil’s reactions to group process, joint teacher-pupil planning and 
evaluating, squads selected on the basis of functional choice tests and 
other democratically oriented devices, were expressed anonymously in a 
44-item “Student Evaluation Questionnaire” circulated the last day of the 
term. The questionnaire included multiple choice and open-end questions. 
The majority enjoyed their class, favored the techniques used to increase 
leadership, interaction and self direction, and were generally enthusiastic 
about the manner in which their class had been conducted. All but one 
girl approved of settling class problems by discussion and consensus. 
About 70% approved of teacher-pupil joint evaluation; many commented 
on the difficulty of judging yourself and others solely on merit, but all 
agreed that more student practice was needed in self and peer evaluation. 
The only unanimity was in the negative reply to the question, “Do you 
® Ibid. 
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feel that anyone in this class was left out of any activities because of her 
race, nationality, religion, or economical status?” Practically all girls 
felt that they had participated in a meaningful democratic group, and that 
their understanding of democracy was greatly enhanced by the living ex- 
periences they had enjoyed. 


All the objective findings accurately reflected the investigator’s empiri- 
cal observations. 


Summary 


A study of historical, sociological, and psychological foundations justi- 
fied democratic methodology in physical education. That these methods 
were practical even in an administratively authoritative framework of a 
large city high school was demonstrated by their use in three girls’ physi- 
cal education classes during one semester. Based on the empirical ‘and so- 
ciometric data which evidenced a term-wise increase in acquaintance vol- 
ume, upward mobility, and group cohesion, and a decrease in the number 
of rejects, isolates, and near-isolates, plus the apporval of the students as 
shown by an unsigned questionnaire, it was concluded that the use of 
democratic methods in three girls’ high school physical education classes 
resulted in socially desirable democratic outcomes. 


Conclusions 


1) Democratic methodology in physical education can be justified 
historically, sociologically, and psychologically in accordance with the cur- 
rent knowledge in these foundational fields. 


2) Some aspects of democratically desirable human relationships as 
evidenced in physical education classes can be measured objectively by 
use of sociometric techniques. 


3) When democratic methodology was employed in three high school 
girls’ physical education classes during an eighteen-week term in the 
setting of a large city high school with an authoritative administration: 


a. Empirically, the methods were found to be practical. 


b. The sociometric data reflect the empirical observations that the following 
outcomes occurred: 


. Marked interaction was evidenced by greatly increased acquaintanceship. 
. Upward mobility was experienced by the large majority of the students. 
. A decrease occurred in the numbers of unchosen, slightly chosen and 
rejected girls. 

. Group cohesion increased slightly. 
. The large majority of the pupils expressed approval and satisfaction. 

. Therefore, since these outcomes are among those deemed socially desirable 
in a democracy, the methodology in these classes appeared to have contrib- 
buted to the furtherance of the democratic ideal among its members. 
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4) If, then, the democratic potentialities inherent in the sport con- 
text were implemented in each school physical education class by demo- 
cratic methods, and, if the outcomes of improved human relationships 
reflected those which occurred in this eighteen-week study, American 
youth should find the kindergarten through junior college physical educa- 
tion requirement a long term, effective, and meaningful experience in 
democratic living. 


BIBLIOGRAPHY 
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The University of Illinois Library has issued a bulletin (U.LC. 
Library Information Circular No. 111, February 1, 1951) which should 
prove to be of great interest to school librarians and counselors. Prepared 
by Robert B. Harness, the bulletin has the title “Subject Headings for 
Pamphlets in an Occupations Vertical File.” The headings in the bulletin 
are planned to help with the arrangement and use of several thousand 
pamphlets on occupations. A limited number of single copies of the pub- 
lication are available and will be furnished without charge to applicants 
who have professional need for the material. Requests should be directed 
to Mr. Harness, University of Illinois Library, Chicago Undergraduate 
Division, Navy Pier, Chicago 11, Illinois. 
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The Cost of Guidance Services In 
Selected High Schools 


JosepH WALLACE CRosBy 
Oxnard (California) Union High School 


Tue major objectives of this survey were: (1) to determine which 
items represents costs which can properly be assigned to the guidance 
services; (2) to determine the actual costs of these guidance services for 
ten selected public high schools in Southern California; (3) to estimate 
the costs of guidance services in the typical high school in California. The 
guidance services studied included: (1) individual appraisal; (2) voca- 
tional and educational information; (3) counseling; (4) group activities 
in guidance; (5) placement and follow-up. 


Items Chargeable To Guidance Services 


In order to determine which items can legtimately be assigned to the 
cost of guidances services a total of 102 check-lists were mailed to nation- 
ally recognized workers in the field of guidance. Approximately 80 per 
cent returned completed check-lists. The consensus of the specialists was 
that the following classses of items are chargeable to guidance: (1) sal- 
aries paid to directors, counselors, clerks, social workers and psycholo- 
gists for performance of guidance functions; (2) tests and the scoring of 
tests; (3) research material for the counselors’ library and for the stu- 
dents; (4) record-keeping devices used for guidance services; and (5) 
expenses for follow-up programs. 


Costs of Guidance Services 


Actual costs were ascertained by a detailed examination of the records 
of ten high schools in Southern California and by questionnaires mailed 
to all schools at the secondary level throughout the state of California. 

If we assume that the items checked by the specialists may be regarded 
as proper charges for guidance services, the ten schools personally sur- 
veyed in the Southern California area may be considered to have a total 





Joseph Wallace Crosby is counselor at the Oxnard, California, Union High 
School. He had previously served for four years as @ high school teacher. He 
attended the University of Southern California and received his doctorate in 1950. 
The present article is a digest of his dissertation. 
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cost range for guidance services from 1.4 per cent to 5.9 per cent of the 
annual current expenditures, for the school year 1947-1948. The cost for 
guidance ranged from $6.00 to $13.02 per student per unit of average 
daily attendance. The composite of the ten schools surveyed indicated that 
the average cost of the guidance services was 3.4 per cent of the average 
annual current expenditure, or $10.48 per student per unit of average 
daily attendance. 

The schools surveyed by means of a questionnaire were divided into 
five classifications based on attendance. The costs are reported in terms 
of the percentage that the guidance costs were of the annual current ex- 
penditures for the school year 1947-1948 and the costs per student per 
unit of average daily attendance. These data for the five classifications are 


shown in Table I. 
TABLE | 


ESTIMATED AVERAGE COSTS OF GUIDANCE SERVICES 
FOR TYPICAL HIGH SCHOOLS 


Percentage Cost Per Student 
Average of Per Unit of 
Daily Total Average Daily 
Classification Attendance Expenditure Attendance 


33 - 300 2.3 $12.58 
301 - 700 2.3 10.51 
701 - 1200 2.2 7.80 
- 1800 3.0 10.72 
- 2850 2.5 6.87 


Conclusions 


The costs of guidance services ascertained from the personal survey 
and those ascertained from the returned questionnaires sent to the high 
schools throughout California were comparable. The major cost of guid- 
ance services as indicated by a detailed survey of ten high schools and by 
the analysis of questionnaires from schools throughout California is that 
for personnel. The smaller schools throughout the state utilize a home- 
room guidance program. The larger schools offer a program based on the 
employment of one or more full- or part-time counselors. Usually guid- 
ance service is a part-time assignment combined with classroom teaching 
rather than a full-time assignment. This arrangement allows more staff 
members to participate in the guidance program. The majority of the 
guidance directors’ time was spent in supervising the program. The great- 
est amount of the counselors’ time given to one function was devoted to 
helping the students plan their programs. The testing program was admin- 
istered by classroom teachers in the majority of schools. 


202 





Acne and Psychological Involvement 


Davip M. SNIDER 
Chico (California) High School 


ln RECENT years the relationship between symptoms of physical disease 
and evidence of mental and emotional disturbance has been securing in- 
creasing attention. Educators concerned with the mental and emotional 
state of individuals will recognize the importance of knowing whether the 
relationship is real and what evidence may be produced in its support. 

Much of the evidence indicating this relationship has been produced 
by those engaged in the diagnosis and treatment of organic disease. The 
method has been largely that of individual case study necessarily quite 
subjective in nature. 


Purpose 


It was proposed in this study to investigation quantitatively through 
use of a standard psychological test the possibility of mental and emo- 
tional disturbance accompanying symptoms of physical disease in those 
persons affected with a common dermatosis, acne. 


Definitions 


Acne Vulgaris, or common acne, is defined in the American Medical 
Dictionary, 21st edition, as a chronic inflammatory disease of the sebace- 
ous glands occurring most frequently on the face, back, and chest. 

The term psychological involvement was used in this study to denote 
any observable mental or emotional disturbance or disorder. 


Related Studies 


The study and treatment of skin disorders have indicated evidence of 
related psychological disturbance although some dermatologists minimize 
or deny the importance of the relationship. Others suggest that all sensi- 
tizations, including symptoms of skin disease, have a significant relation- 
ship to mental and emotional factors involved (9). 


David M. Snider is a social studies teacher and principal of the Chico, Cali- 
fornia, Evening High School. He has also taught at Redding, California. In addi- 
tion to teaching, Mr. Snider has served as a school trustee at Manzanita. His article 
is based on his Master’s thesis which was completed at Chico State College in 
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Cornbleet and Brown (3), after describing four common psychiatric 
disorders in which changes in the skin condition occur, have concluded 
that certain signs of the skin are often indicative of underlying phychiatric 
disorders. 


Dunkel (5), in a study of forty-five neurodermatitis patients, lists the 
many emotional factors she believes involved and notes three related 
trends as: difficulty in establishing useful relationships, general craving 
for affection, and hostility and thinly disguised depression. 


Experimental methods have been used to demonstrate a relationship 
between emotional states and physical symptoms of disorder. Doswald and 
Kreibach (4) first demonstrated that skin blisters can be produced hyp- 
notically. Abramowitz (1) reports the use of placebos (sugar pills) useful 
in many cases of dermatosis along with the use of catharsis in dealing 
with associated mental and emotional problems. In introducing his dis- 
cussion he mentions that Block, a dermatologist, was able to cure warts 
by auto-suggestion. 

Montgomery (6) reports the successful treatment of a case of severe, 
recurrent acne through psychoanalysis. Guilt, anxiety, and narcissism are 
given by the analyst as the main areas of involvement. 


It should be noted that acne receives only minor mention in the liter- 
ature as a dermatosis in which there is demonstrable psychological in- 
volvement. Obermayer (8) mentions acne last in a graded list of the 
dermatoses in which emotional disturbance can be shown. However, the 
common incidence of acne and its easy recognizance makes it logically a 
dermatosis with which to begin quantitative investigation of related psy- 
chological involvement. 

The one quantitative study reported is that of Narciso (7) who used 
the Minnesota Multiphasic Personality Inventory (M.M.P.1.) at the Univ- 
ersity of Texas to compare a group of twenty students affected with acne 
with a control group matched in regard to age, sex, and classification in 
school. He found statistically significant differences between the acne 
group and the control group in four of the nine scales of the M.M.P.I. as 
follows: Hypochondriasis, Hysteria, Schizophrenia, and Psychasthenia. 





Present Study 


It was proposed in the present study to extend the conditions of the one 
quantitative study reported by increasing the number of subjects, by select- 
ing the acne subjects according to medical diagnosis, and by including a 
measurement of intelligence as an additional factor in matching. 

Subjects. The acne group of 36 persons was made up of those fresh- 
men entering Chico State College during the period of September 1949 to 
February 1950, inclusive, who were diagnosed by the staff doctor as active 
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acne cases. The group was made up of 12 women and 24 men. The diag- 
nosis of acne was made during the regular college entrance general phys- 
ical examination. 


Other bases of matching were performance on the American Council 
on Education Psychological Examination for College Freshmen (A.C.E.), 
age at time of taking the examination, and sex. Performance on the 
A.C.E., a test of scholastic aptitude, was matched within five percentile 
units, plus or minus, using Chico State College norms. Age was matched 
within one year, plus or minus. 

Instiument. The Bell Adjustment Inventory, Student Form, is the 
standard psychological test which was used in this study to investigate 
possible psychological involvement associated with the incidence of acne. 
This instrument is a standard personality inventory providing four sep- 
arate measures of personal and social adjustment (2). The total score 
may also be used to indicate general adjustment status. 

Method. The A.C.E. and the Adjustment Inventory were administered 
as part of a battery of standardized tests regularly given freshmen enter- 
ing Chico State College. Comparison of individual scores on the Adjust- 
ment Inventory was by the method of differences. Standard statistical 
methods were used for determining the significance of differences between 
the means of the acne group and the control group for each of the five 
scales of the Adjustment Inventory. The significance of the mean differ- 
ences was determincd for the total population studied as well as for the 
population classified by sex. There were 12 matched pairs of women 
studicd and 24 matched pairs of men studied. 


Results. The reliability of differences was tested by the matched pair 
technique. As indicated by the following tables, there was no significant 
difference between the means of the acne group and the control group in 
any of the five measures for the total population or when the groups are 
considered separately by sex. 


TABLE | 


COMPARISON OF ACNE AND CONTROL GROUPS ON 
ADJUSTMENT INVENTORY 
(COMBINED SCORES, MEN AND WOMEN, 36 MATCHED PAIRS) 


Mean Mean S. E. 
CATEGORY Acne Control Mean of the Significance 
Group Group Difference Differences Ratio 


5.83 31 1.19 .26 
6.81 1.00 81 1.23 
12.53 08 1.71 34 
8.92 00 1.11 
34.08 22 3.47 
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TABLE I! 


COMPARISON OF ACNE AND CONTROL GROUPS ON 
ADJUSTMENT INVENTORY 
(WOMEN, 12 MATCHED PAIRS) 


Mean . Mean S. E, 
CATEGORY Acne Control Mean of the Significance 
Group Group Difference Differences Ratio 
4.92 6.67 1.75 2.00 
7.75 1.75 1.01 
16.66 ony. 2.90 
14.42 1.92 1.30 
45.50 5.25 4.45 


TABLE Ill 


COMPARISON OF ACNE AND CONTROL GROUPS ON 
ADJUSTMENT INVENTORY 
(MEN, 24 MATCHED PAIRS) 


Mean Mean S. E. 


CATEGORY Acne Control Mean of the Significance 
Group Group Difference Differences 


5.41 42 1.48 
6.33 63 1.14 
10.46 79 2.16 
6.17 1.71 1.50 
28.38 2.29 4.67 49 


In some categories of the inventory, indicated differences, although not 
significant, varied according to sex. Based upon college norms, means for 
all groups were indicative of average adjustment status. 


Findings 

The results of this study did not agree with those of Narciso. Some 
differences in procedure have been briefly noted in this report. Other dif- 
ferences should be mentioned. The mean age tof the subjects in Narciso’s 
study was twenty years. The mean age of the subjects in this study was 
eighteen years. Since the incidence of acne is commonly associated with 
adolescence, it is possible that psychogenic factors in acne are not as 
readily differentiated at this age as at a later age. 

The diagnosis of acne was made in Narcisco’s study by non-profes- 
sional observation. In the present study diagnosis of acne was made by a 
doctor of medicine. While it is probable that diagnosis in this study was 
more accurate; it is also likely that since diagnosis in Narciso’s study was 
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non-professional, only the more severe cases of acne were noted and in- 
cluded. Thus the severity and duration of the disease may have been 
factors associated with more severe and, therefore, more easily detected 
psychological involvement. 


The differences in the tests used should be noted. It is possible that the 
Minnesota Multiphasic Personality Inventory used in Narciso’s study, with 
a greater number of questions and scales and designed specifically for 
clinical use, is more sensitive for purposes of this type of study. 


The results of the present study differ from the clinical findings pre- 
viously mentioned. The possible relationship of the severity and length of 
duration of acne to the ease of detection of possible psychological involve- 
ment has been discussed. Presumably, those individuals seeking clinical 
treatment for skin disease make up a group containing a larger percentage 
of cases of advanced severity and long duration than the group of acne 
subjects in this study. 


The indication of possible sex differences observed in this study sug- 
gests a need for an investigation using a larger population so that larger 
samples could be studied for each sex. 


Summary 


Thirty-six persons affected with acne were compared in matched pairs 
with 36 persons not so affected for the purpose of investigating quantita- 
tively the possibility of psychological involvement accompanying acne. 


The bases of matching were age, sex, year in school, and performance 
on the A.C.E. scholastic aptitude examination. The comparison was made 
by use of the Bell Adjustment Inventory. 


Conclusions 


Under the conditions of this study, a quantitative method disclosed no 
significant relationship between psychological involvement and the in- 
cidence of acne in the subjects studied. 


It is suggested that the age of the subjects and the severity and dura- 
tion of the acne are significant variables to be given further consideration. 
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THE EDITORS SAY: A Bold Venture 


Continued from Page 194 


Following the establishment of the clearing house, a classified biblio- 
graphy of the researches was prepared and distributed to the cooperating 
districts, counties, colleges and universities. Coincidentally, annual classi- 
fied bibliographies of California theses and dissertations were under- 
taken; these have become standard references in the graduate schools of 
education. 


Another means of promoting coordination has been the development 
of an annual statewide conference on educational research. Directly and 
indirectly, attention has focused on the possibilities of coordinating re- 
search. At the 1951 Conference, held at Santa Barbara last month, a 
special section discussed ways and means of achieving cooperation be- 
tween the colleges and universities, the local and county school systems, 
the State Department of Education, the Association of School Admini- 
strators, and the California Teachers Association. Representatives of the 
various research agencies unanimously agreed that it would be advantage- 
ous to all concerned to effect statewide coordination of research effort. 
Machinery was set up for fostering such cooperation. 


The California venture in coordination will be interesting to watch. 
If it succeeds, much time, effort, and money will be saved. More im- 
portant, the quality of educational research should improve. 
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Predicting Future School Enrollments 


Louis GRANT BRANDES 
Alameda (California) City Schools 


Tue large increase in pupil population, born during and since World 
War II, has been swelling the enrollments of schools throughout the na- 
tion for the past several years. Many areas, in addition to increase in 
pupil population as the result of increased birth rate, have had a large 
influx of population, brought about by the creation of military and 
industrial developments for the purpose of national defense. 


Administrators have long sought some “magic” formula that would 
provide a simple and reliable predicted enrollment. Educators might well 
face facts; there is no such “animal.” Formulas thus far developed have 
proved of little or no value. 

It seems reasonable to believe, however, that reliable enrollment pre- 
dictions can be made when based upon a study of an individual com- 
munity. If this assumption is accepted, then school districts should not 
hesitate to predict future enrollments as a basis for making long range 
current expenditure and capital outlay budgets. A district can survey its 
attendance areas, study its community as compared to past, present, and 
future enrollment records, and otherwise make observations of enrollment 
trends that will establish a basis upon which to make enrollment pre- 
dictions. 


Techniques Used 


In gathering data that would provide information upon which to base 
predicted enrollments for the Alameda Unified School District the follow- 
ing considerations were given: 


1. Enrollments of prior years were carefully studied. Grade by grade 
drop-outs for prior years were computed. Comparison was made 
of enrollments with city, state, and national birth rates. Yearly 
enrollments, broken down by grade, were compared in an effort 
to establish a period of stability that could be considered as nor- 
mal for prediction purposes. 

Louis Grant Brandes is beginning his fifth year in the Alameda, California, City 
Schools, where he serves as administrative assistant. He had formerly taught in the 
Washington College Academy in Tennessee. Mr. Brandes attended the University of 
California, Berkeley, and was awarded a Master’s degree in 1949. He is currently a 
candidate for the doctorate in educational administration at the same institution. 
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2. Housing data were collected from the City Offices and from local 
building contractors. Comparison of housing data with yearly 
enrollments was made and trends observed. Areas that might sup- 
port housing developments were carefully investigated for building 
possibilities. 
Data were collected from organizations and businesses employing 
large numbers of persons concerning past, present, and future 
employment. Trends of employment for the population of the 
District were observed. 


Census information including number of houses, district popula- 
tion, and school population was gathered and studied. 


All factors found to relate to future enrollments were applied to 
prior enrollments in an effort to predict present and prior enroll- 
ments. Index factors were computed from these comparisons. 
These index factors were studied and revised until enrollments 
could be predicted for present and prior years with a minimum of 
error. 


Factors Used in Making Basic 
Enrollment Predictions 


Four factors were found to be instrumental in predicting future 
school enrollments in the City of Alameda and were thus taken into con- 
sideration in the prediction of basic 1951 to 1955 enrollments for cle- 
mentary and secondary schools. These factors include: 


Birth rate, as it applies to the State of California. 
Development of housing units within the District. 
Yearly projection of enrollment by grade. 


Grade by grade drop-out of pupils. 


Birth Rate: An examination of prior enrollments and the birth rates 
for the years corresponding to the grades of children in school indicated 
a low positive correlation between local birth rates and past enrollments. 
Indications were, however, that a high positive correlation existed between 
both national and state birth rates and prior enrollments. Birth rate 
factors as they applied to the State of California for the years 1945 to 
1950* were determined for the purpose of computing projected enroll- 
ments for kindergarten and Ist grades. Assuming the birth rate for 1945 


* State birth rates for the State of California were not found available for 1949 and 
1950. Thus, index factor estimates were made for kindergarten in years 1954 and 
1955 and for the Ist grade in 1955. 
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to be index 1.00, indices were determined for successive years. The fol- 
lowing index factors were then computed: 


1950 1951 1952 1953 1954 1955 
Kindergarten 1.00 1.07 1.14 1.06 1.07 1.07 
Ist Grades 1.09 1.12 1.24 1.15 1.12 


Housing: Records of the City of Alameda indicate that since 1945 
there had been an average of 183 housing units added in the city each 
year. The difference from the mean for any of these years did not exceed 
15% of the mean. Thus, the growth in housing was assumed to be constant 
and 183 units was taken as the normal housing growth for the purpose of 
projected enrollments. Growth in enrollment due to normal housing 
growth is accounted for by the correction for drop-outs in grades 2 
through 12. The growth in the kindergarten and first grade, however, 
will be determined by increases in population resulting from normal 
growth of housing. Thus, a housing index of .047 and .051 was computed 
and applied to this house count for each year of projected enrollment for 
kindergarten and first grades, respectively.” This computation provided 
an increase of 7 and 8 pupils, respectively, for each year of kindergarten 
and first grade projected enrollment. 

Projection of enrollment: Grade enrollments were projected year by 
year with exception of the kindergarten and first grades. Observation of 
enrollments from 1947 to 1950 indicated a stabilization of enrollment in 
these grades, with differences from the mean of less than 10% for any 
two comparable years, when growth resulting from normal housing 
development was included. This difference from the mean was directly 
attributed to birth rate increases. The kindergarten and first grade en- 
rollments were thus assumed to be constant for projection purposes. 

Drop-out: Drop-out factors were computed for each grade, 2nd 
through 12th, as indicated by school enrollments of 1946 to 1950, in- 
clusive. The drop-out factor is the ratio of the number of pupils that drop 
out of a grade by the beginning of the following year as compared to the 
number of pupils enrolled in a grade at the beginning of the year. The 
following drop-out factors were found to exist in the Alameda Public 
Schools: 


m2 2 3 4 5 6 7 8 9 10 ll 12 
00 .00 —.152 —.067 —.055 —.072 —.040 —.023 —.048 +.030 —.057 —.196 —.134 


Thus the following index factors were applied to the projected enroll- 
ments of each grade. 


| a 2 3 4 5 6 7 8 9 10 ll 12 
1010 848 933 .945 .928 .960 .977 .952 1.030 .943 804 866 


* Housing index factors for all grades are broken down on page 214. 
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The 1st grade enrollment is the enrollment which determines the en- 
rollments of the upper grades as it is projected each year. The Kinder- 
garten enrollment is not projected to determine the lst grade enrollment. 
Two factors determine increases for Kindergarten and lst grade; namely 
birth rate and additional housing. 


Increased enrollment as the result of normal housing development 
within the district is computed via the drop-out factor in all but Kinder- 
garten and lst grade. 


Examples of computations are as follows: 


Computing 1951 Kindergarten enrollment: 
October 1950 Kindergarten enrollment: 984 
Apply birth rate factor: 1.07 « 984 = 1053 
Normal housing factor: 183 & .047 = 7 
Computed enrollment: 1060 


Computing 1951 Ist Grade enrollment: 
October 1950 Ist Grade enrollment: 1050 
Apply birth rate factor: 1.09 « 1050 = 1144 
Normal housing factor: 183 « .051 = 9 
Computed enrollment: 1153 


Computing 1951 2nd Grade enrollments 
October 1951 1st Grade enrollment: 1059 
Apply drop-out factor: 1059 « .848 = 898 


The drop-out factor is the only factor applied to projected enrollments 
beyond Ist grade until computations are made for new housing develop- 
ments. 

These drop-out index factors were applied to each projected enroll- 
ment for each grade level. 


Basic Predicted Enrollment 


When the four factors found to influence future enrollments in the 
Alameda Public Schools were applied to the current enrollment data a 
basic predicted enrollment was derived as indicated in Table I. This basic 
predicted enrollment is the future enrollment which can be expected in 
event that conditions within the District remain static. From this basic 
predicted enrollment it is possible to apply alternate trends that may 
develop. It may be desired that several predictions be made on the basis 
of several alternate possibilities that may develop in the future. 


Effect of Anticipated Housing Developments 
on Predicted Enrollments 


One major possibility presents itself for consideration in predicting 
future enrollments for the Alameda Public Schools. This possibility is 
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the development of tideland areas to supplement the current housing 
shortage. Thus, an alternate prediction was computed. 


Two large housing developments have been planned for the City of 
Alameda; one development by the Alameda Bayside Construction Corpo- 
ration, the other by Johnson, Drake, and Piper Construction Company. 


A letter from the Alameda Bayside Construction Corporation stated 
that the company expected to complete 800 apartment units by October 1, 
1952, and to include 1205 units in the total project. 


A second letter from Johnson, Drake and Piper Construction Company 
indicated that they expected to complete 810 units on Bay Farm Island 
by October 1, 1952 and to include 1500 units in their total project. 


Thus, it was assumed in projecting school enrollments to include 
housing developments that 1610 units would be completed by October, 
1952, and an additional 1095 units would be completed by October, 
1955, with the latter completed over the three-year period from 1953 to 
1955 at the rate of 365 units a year. 


The 1950 census of the City of Alameda reported 21,253 housing 
units in the city. The pupil population as of October, 1950, when com- 
pared with the total number of housing units, produced an enrollment 
index of .3429 elementary pupils per housing unit and .0935 secondary 
pupils per housing unit. Broken down by grade these index factors are as 
follows: 


K 1 2 3 4 5 6 7 8 9 0 lk W&@ 
Index .047 .051 .044 .041 .037 .033 .031 .028 .039 .027 .025 .021 .019 


The enrollment index factors were applied to the number of antici- 
pated housing units and combined with the basic predicted enrollments. 
This provided an alternate prediction, as indicated by Table II, based 
upon the assumption that certain housing developments would take place 
within the District. Other alternate predictions can be made as additional 
data concerning construction developments becomes available. 


Summary 


In making a study of a community for the purpose of predicting 
enrollments the concept that every community is different should be kept 
in mind. Factors that will be variables in one community will be con- 
stants in others. The method used in predicting the enrollments for one 
school district may not be appropriate elsewhere. Each school district 
will find it necessary to examine itself in terms of pupil population trends 
within the district. Alternate predictions should be made for any one or 
more factors that are likely to be uncertain. 
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Item Analysis for Diagnosis and 
Curriculum Revision 


Howarp A. BowMAN 
Los Angeles City Schools 


One of the common methods of investigating the progress of pupils 
through school involves the use of standardized achievement tests of vari- 
ous kinds. Ordinarily results are observed in terms of the attainment of 
individual pupils and of groups of pupils, and may be expressed as grade 
placements, scaled scores, standard scores, achievement ages, or in several 
other manners. 


Individual vs. Group Diagnosis 


It is obvious that the use of group averages tends to obscure the per- 
formance of individual pupils. In the case of a survey given to a school 
system, the classroom teacher or the principal of an individual school 
often laments that “While the group averages are interesting, they don’t 
tell me what I want to know about Willie Jones.” 


Such a criticism is unanswerable. The only way of finding out the 
facts with reference to Willie Jones is to examine Willie’s test perform- 
ance in great detail, conducting such diagnostic analysis as the test will 
permit. 


There is, however, another area into which group results may be 
channeled, and which may ultimately be more productive than spending 
a great deal of time analyzing individual test papers. 


It need scarcely be pointed out that it does little good to make an 
exhaustive analysis of Willie Jones’ paper unless something is subse- 
quently done about his shortcomings. With classes composed of thirty to 
forty pupils, and a given class in junior or senior high school lasting forty 
or fifty minutes, it is probably fair to say that the amount of individual 
analysis and remedial or enrichment instruction that the teacher can de- 
vote to each pupil is severely limited. Time and cost considerations have 
long dictated the policy of teaching groups rather than individuals. It is 


Howard Bowman is supervisor of test construction in the Los Angeles City 
Schools, a position he has held for the past four years. His previous experience in- 
cludes teaching, counseling, and the serving as registrar. His collegiate training was 
taken at the University of Southern California, where he received his Master’s 
Degree in 1938. Mr. Bowman’s article is based on a paper which he presented at the 
1951 annual conference of the American Educational Research Association. 
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for this reason that school curricula are commonly designed in terms of 
the learnings desirable at each stage of progress through the grades. 


Assumptions 


We should remember, however, that any achievement test is composed 
of individual items which sample the learnings presumed to have taken 
place. It is axiomatic that one factor influencing the accuracy of measure- 
ment of these learnings will be the extent of the sampling. It should be 
possible to assume that reputable publishers of achievement tests make an 
adequate sampling of the learnings which are generally considered to be 
desirable. It should also be possible to assume that the norms published 
for use with these tests are based upon the performance of a large group 
of pupils of widely varying backgrounds, abilities, interests, and so forth, 
so that the standardization population represents a true cross-section of 
American youth of that particular age. 


Making the assumptions mentioned above is, of course, a somewhat 
dubious undertaking. However, when schools use standard achievement 
tests, they are tacitly making these assumptions. Moreover, they are often 
making these assumptions without realizing they are doing so. 


Unfortunately, there is little that can be done with reference to the 
norm problem. Test publishers usually provide, even in their published 
manuals, data which are insufficient for the purpose of deciding whether 
test norms are adequate. 


Test Analysis 


On the other side of the picture, however, is the test content, com- 
posed of individual items exposed to the possibility of critical analysis by 
anyone who has a copy of the test and some background upon which to 
base his analysis. It is in precisely this area that it becomes possible to do 
constructive work with reference to the relationship between the test con- 
tent and the curriculum. — 


Some time ago Dr. E. F. Lindquist of the State University of Iowa 
suggested to the writer the possibility of profitably analyzing achievement 
test results shown by members of a group in answering each item. Subse- 
quently Dr. Lindquist made such an analysis based upon the performance 
of Los Angeles high school pupils on one of the sub-tests of the Jowa 
Tests of Educational Development. 


In attempting to make these and other subsequently obtained data 
more usable to administrators, supervisors and teachers, the staff of the 


Evaluation Section of the Los Angeles City Schools developed two methods 


of presentation. These are shown in Figures 1 and 2. 
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Figure 1 illustrates a graphical procedure suitable for use in those 
cases in which the local group is compared with a standard group. 


On this chart, item numbers are arranged across the bottom in order 
of item difficulty for the local group. The numbers in vertical columns to 
left and right of the chart itself represent the item difficulty in terms of 
the percentage of correct responses. The line starting at the lower left 
and progressing upward and across the chart traces the item-by-item 
achievement of the local group in order of the decreasing difficulty of 
items. The shaded areas above or below the line represent, item by item, 
the performance difference between the local group and the standard 
group. It must be pointed out that these percentage differences do not 
present a constant degree of significance across the scale, since they are 
subject to the various errors inherent in this type of analysis. For all 
practical purposes, however, a percentage difference of five points at either 
end of the scale, and of ten points at the center of the scale, may be 
considered significant. 


Because it is not feasible to show the exact nature of each item on 
this type of chart, there is need for some supplementary data. These are 
provided in the shape of an analysis of the content of each test for which 
a chart is made. Each analysis groups the items into categories. These 
may be the original areas into which the test makers were attempting to 


channel their items, or they may be divisions which appear rational to 
subject matter experts within the school system. Such an analysis accom- 
panies each chart, and shows the numbers of the items dealing with the 
various areas covered by the test as a whole. A sample of such supple- 
mentary data is shown below. 


CLASSIFICATION OF TEST ITEMS—IOWA TESTS OF EDUCATIONAL 
DEVELOPMENT 


Test No. 3: CORRECTNESS AND APPROPRIATENESS OF EXPRESSION 


Classification Items 


I. Basic Construction 
A. Parts of speech 
B. Subject and verb 
C. Verb and complements 
D. Verb phrase 
E. Dependent clause 
II. Composition and Rhetoric 
A. Coherence 
B. Avoidance of mixed metaphors 
C. Unity — paragraphing 
D. Case of pronoun 
E. Adjectives and adverbs 
1. Distinctions in form 
2. Distinctions in function___- 
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IV. 


VI. 


Vil 
VII. 


Ill. 


Diction 
A. Common faults —-.....------ 
B. Language level (colloquial out 
On OU: scieah crc ccna 
C. Signature of a letter __._._-_-_ 
Punctuation 
A. To separate coordinate elements 
B. To set off subordinate elements 
C. To set off independent ele- 
ments, dates, and addresses___ 
D. Other 
oo ec es 
le tes ee 
3. Quotation marks -__------- 
Special Structural Problems 
A. Dangling modifiers ____.--__- 
B. Misplaced modifiers -------~- 


C. Parallelism — joining equal 
GORE acini cians selma ate 
Spelling 
A. Capitatastion ......-...cc. 
B. Apostrophe — in possessives; 


to show contractions ~..--_~- 
a 
Dy IE cicencaeunesweseus 
Style or Form of Presentation...-- 
Usage 
A. Special verb forms (principal 
CE) . pntinseeastneneeeenee 
B. Agreement of subject and verb 
C. Pronouns — 
1. agreement in person -_---_- 
2. agreement in number —----- 





ITEM ANALYSIS FOR CURRICULUM REVISION 


27, 33, 38, 41, 52, 53, 55, 58, 60, 65 


5, 18, 21, 27, 51, 75 
22 


11, 16, 45, 68, 74, 78 
32, 34, 39, 50, 63, 72, 73, 87 


2, 4, 22, 26, 66, 67, 81, 88 
35 
50 
66 


8 
4, .7, 20, 54, 62 


6, 17, 23, 71 

3, 12, 40, 46, 49 
33 

Rte 


30, 37, 43, 57, 64, 76, 82, 83, 86, 89, 103 
22, 54 


58, 61, 65, 84 
28, 44, 70, 80 


The second method of illustrating the item by item performance of 
local groups is shown in Figure 2. This method is based upon the use of 
test data involving a local group only, no standard comparison group 
being available. In this case the instrument was the Progressive Achieve- 
ment Battery. 


Because the analysis itself was hand made on the basis of a sample of 
500 cases, it was decided to tally rights, wrongs, and omits. Thus on 
Figure 2, it has been possible to show all test identifications, the exact 
wording of the item, the correct response, the publisher’s norm level, the 
grade level at which item is taught in the Los Angeles schools and, finally, 









the proportions of the group answering the item correctly, responding in- 
correctly, or failing to attempt the item. 
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November 1951 ITEM ANALYSIS FOR CURRICULUM REVISION 


Use of Charts 


All of the foregoing merely indicates how to make some very ordinary 
charts. The real crux of the matter lies in the use made of these charts. 
The theory behind using the charts is based upon several factors: 

1. Courses of study are likely to show some considerable variation in sequence 

and scope from district to district. 


2. A local course of study may meet local needs adequately and yet be at con- 
siderable variance with the “typical” scope and sequence as expressed in the 
items of achievement tests. 


3. If there are any considerable differences between the average performance of 
a local group and the average performance of a standard group, it is neces- 
sary to decide whether such differences are desirable or undesirable. 


Fundamentally, the decision which must be made is based upon the 
philosophy of education which forms the foundation of the district’s cur- 
riculum. Let us take an hypothetical case to illustrate this point. 


Let us suppose that a well made social studies test is administered to 
pupils in grades 10, 11, and 12 in a high school. Upon comparing the 
average achieved in the case of the tenth grade group with the average 
achieved by the standard group, it is observed that the local group is 
performing considerably below the level considered adequate for that 
grade. 

Had that tenth grade group been the only one tested in the school, the 
administrator might have concluded that the social studies program was 
woefully weak, and might have taken steps to modify the program. 

However, our hypothetical school had also administered the same test 
to eleventh and twelfth graders. Eleventh grade pupils, it was discovered, 
showed an average score nearly up to the average score of the standard 
group, while twelfth graders considerably surpassed the standard group. 

The administrator concludes that the school’s social studies program 
is perfectly adequate, basing his conclusion on the premise that what we 
are really after is graduates who are good achievers rather than tenth 
graders who are good achievers. 

It is readily possible to extend this analysis to the area of individual 
items within the test. Suppose that the administrator finds his class below 
average. It is then to his advantage to be aware of the specific type of 
item upon which they do not perform well, and the specific content 
upon which they do not perform well. If, for example, the social studies 
program is one which prides itself upon instilling in the pupils a knowl- 
edge and appreciation of broad social concepts, the administrator may 
decide to overlook inability to cope with questions dealing with names, 
dates, and places of historical events. 

Conversely, it is readily possible to make decisions in the opposite 
direction. A substantial number of pupils are unable to answer a given 
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item correctly. Upon examination, the item appears to be one which is 
perfectly practical and a highly desirable knowledge is involved in its 
solution. With these clues it is often possible to discover those points at 
which the “skimming over” process has been a bit too light, and then do 
something about remedying the situation. 


Obviously, this type of analysis is perfectly appropriate in any subject 
area. It is another way of pointing up the fact that a figure which ex- 
presses the average group performance on a test is but a small fraction of 
the story. Group tests do not provide the detail and the precision of 
individual diagnostic tests. However, the results may be analyzed in such 
a way as to furnish very definite and practical suggestions for classroom 
teaching. 


* * * * * 


Whatever the education for yesterday may properly have been, edu- 
cation for today is not merely the memorization and retention of facts. 
A person may be well stuffed with information and still be very poorly 
educated. Education for our times includes thinking as well as knowing. 
It seeks to build sound ideals and useful habits. (Schools For Our Times, 
Annual Report of the Executive Secretary of the National Education Asso- 
ciation, 1951, p. 4.) 


There are several factors operating to increase the cost of education. 
The school-age population is increasing. Education must be provided for 
more children. The value of the dollar is decreasing. It takes more dollars 
to buy the same education. The American people are demanding a high 
quality of education just as they are demanding higher quality in auto- 
mobiles and other goods and services. Better education costs more. 
(Schools For Our Times, Annual Report of the Executive Secretary of the 
National Education Association, 1951, p. 4.) 


* * * * * 


The teacher is the heart of the school. Within the teacher lies the 
greatest weakness or the greatest strength of American education. Those 
who would improve educational opportunity must look first to the teacher. 
They can do no less than demand that those who serve in this position 
be professional in their preparation, professional in their conduct, pro- 
fessional in their vision. (Schools For Our Times, Annual Report of the 
Secretary of the National Education Association, 1951, p. 6.) 
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Reactions of Recent High School 
Graduates With Implications 
for Guidance 


MarIAN C. CLIFFE 
Los Angeles City Schools 


Ths study of the reactions of recent high school graduates with impli- 
cations for guidance is a follow-up of the graduates of nine Los Angeles 
city high schools. By means of a questionnaire, an effort was made to 
determine whether or not there were measureable relationships between 
certain specific aspects of the guidance programs of these high schools 
and the present occupational or educational status of graduates. The study 
was expected to reveal some of the strong and weak features of the guid- 
ance program, to disclose areas which might require additional emphasis, 
and to point out the direction which the expansion of guidance services 
might well take. Because of the close relationship which generally exists 
between curriculum and guidance, the survey was also designed to pro- 
vide information relevant to improvement in curricular offerings. Certain 
criteria were developed from the literature and were employed in evalu- 
ating the programs of the various high schools. 


Method of Procedure 


The opportunity for conducting this study was presented by the Evalu- 
ation Section of the Los Angeles City Schools. The plan was to question 
graduates of nine representative Los Angeles city high schools distributed 
throughout the school system. The population chosen for the study in- 
cluded all the June, 1948, graduates of the nine selected schools. A ques- 
tionnaire was sent to these graduates. It explored five areas, namely: 
personal data, high school experiences, post-high school employment, post- 
high school education, and general evaluation. Approximately three-fifths 
of the questions requested factual data; the other two-fifths asked for 
opinions or judgments. 


Marian C., Cliffe is an instructor and counselor in the secondary schools of Los 
Angeles City, a position she has held for the past five years. Most of her professional 
experience has been in Los Angeles. She received her doctorate from the University 
of Southern California in 1950. Her article is based on her dissertation. 
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Those graduates who did not return the questionnaire were urged to 
do so by postal card and later by letter. Finally, phone calls or home 
visits were made to those who had not responded. The result was that 
information was obtained concerning 96 per cent of the 1827 graduates 
included in the study. Another three per cent were reported to have moved 
out of the area. The remaining one per cent could not be located. The 
data obtained from the questionnaires were tallied and reduced to per- 
centages. Because of the possibility of important relationships between 
them, some questions were considered two or three at a time by means of 
cross-tabulation. 

Certain phases of the study have been chosen for summarization here. 
These have to do with answers to the following questions: 

1. What is the role of vocational interest in post-high school activi- 
ties? 

2. In what ways is continuation in school after high school gradua- 
tion correlated with intelligence, high school major, and work experience? 

3. In specific areas, what satisfactions and dis-satisfactions are 
shown by the graduates with regard to the guidance program? 


Findings and Conclusions 


1. An investigation of the role of vocational interest in post-high 
school activities revealed that: 

a. One graduate in three was in need of vocational guidance and 
assistance to find work in line with his expressed vocational interests. 

b. Among those responding, the ratio of those who were engaged in 
a vocation somewhat in accord with their vocational interests, or were 
taking courses appropriate to them, to those not so engaged was two to 
one. 

c. Graduates working in the commercial, mechanical, and social fields 
were the ones most likely to have vocational interests congruous to their 
employment. 

d. Girls working in the scientific field were the ones least likely to 
be interested in their work. 


2. An inquiry was made into ways in which continuation in school 
after high school graduation is correlated with intelligence, high school 
major, and work experience. 

a. A positive relationship was found between intelligence and years 
of schooling. 

b. More boys than girls appear likely to pursue further education. 

c. Twice as many girls as boys found employment soon after gradu- 


ation. 
d. Boys with vocational goals in the mechanical field and girls with 


commercial goals were the ones most likely to be employed. 
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e. Those graduates with academic majors were the ones most likely 
to continue their education beyond high school. 

f. Any effect which work-experience might have had upon the gradu- 
ates’ decisions to continue in school or to go to work could not be ascer- 
tained from the answers to the questionnaire used for the purposes of 
this study; working during the high school career was an experience 
common to approximately four-fifths of the graduates. The prevalence of 
work-experience records made it impossible to identify them as casual 
factors for any observed pattern of responses. 


3. The satisfactions and dissatisfactions of the graduates with specific 
areas of the guidance program were reported in their replies to “direct 
answer,” “controlled response,” and “free answer” types of questions. 

a. Senior Problems, a course with guidance content, was reported to 
be helpful by approximately one half of the total number of graduates. 

b. Those who stated that the course was useful in helping them pre- 
pare for employment outnumbered those who stated specifically that the 
course was not helpful by more than two to one. 

c. The tenth grade guidance unit (a part of the tenth grade English 
course in Los Angeles city schools) was remembered as a guidance ex- 
perience by fewer than one-third of the graduates. 


d. More than one-half of the graduates were dissatisfied with the 
major subject studied in high school to the extent that they reported they 
would take a different major if they had their high school work to do 
over again. This response indicates a need for considering possible 
changes in curricula, instruction, and guidance in order that requirements 
of pupils may be met. 

Further investigation in the area of high school majors appears to be 
urgent. It was apparent that some graduates expected more of the major 
subject in the way of vocational preparation than was reasonable. There 
appeared to be a great lack of understanding of the functions, worth, and 
limitations of the major subjects. This finding supplied additional evi- 
dence of the need for more guidance. 

Some majors were more satisfactory to graduates than were others. 
The academic course would claim one-half of the total number of boys 
enrolled in school could the graduates repeat their high school careers, 
and the commercial course would interest one-half of the girls. All other 
courses would lose more than one-half of the girls and boys enrolled in 
them. The general course (with a loss of 80 per cent of the boys enrolled 
and 90 per cent of the girls) and the vocational arts course for girls (with 
a 90 per cent loss) had the most unsatisfactory ratings. 

e. A large majority of the graduates believed in the value of personal 
counseling during the high school career. Two-thirds of them suggested 
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one hour or more per pupil per year as a desirable allotment of counselor 
time. The graduates reported a need for more and better guidance and 
for greater flexibility in the curriculum. There were indications also of a 
need for adequate explanation of the guidance program to high school 
pupils and to the public. 

f. Educational values afforded by the high school were the ones most 
important according to the responses of the graduates, although social 
and personality values received considerable mention. One graduate in 
fourteen asked that the educational standards of the schools be raised, 
thus indicating an interest in the better teaching of subject matter. Ap- 
proximately one graduate in six asked for improvements in the faculty. 
Specifically, they requested greater personal interest in pupils, more under- 
standing, and, in a few cases, better instruction. 


Summary 


The phases summarized here from the reactions of recent high 
high school graduates with implications for guidance revealed a need for 
an expanded guidance program. One-third of the graduates indicated that 
they required help in planning for the future. Many did not know of the 
opportunities and requirements of the vocational areas in which they 
were interested. However, the ratio of those who were engaged in a voca- 
tion somewhat in accord with their vocational interests, or were taking 
courses appropriate to them, to those who were not was two to one. 

Continuation in school after high school graduation was more likely 
for academic majors than for others. Boys were more likely to continue 
in school than girls. There was a positive relationship between I.Q. and 
continuation in school. Boys with goals in the mechanical field and girls 
with goals in the commercial field were the ones most likely to be em- 
ployed. Inasmuch as work-experience during their high school careers was 
reported by most of the graduates, it could not be identified as influenc- 
ing post-high school status. 

Graduates, in general, felt that they needed more guidance than they 
had received in high school. They reported dissatisfaction with ther major 
subject of study. They pointed out the need for increased understanding 
and personal interest on the part of the faculty. They stressed the import- 
ance to them of the educational values they received from high school, 
naming them more frequently than social, personal, or other values. 





When Pupils Rate Their Teachers 


James G. Cooper 
Modoc County (California) Schools 


Wir some circles, considerable apprehension has been voiced over 
the notion of asking pupils to rate their teachers. Teachers say that pupil 
ratings are not valid because they are markedly affected by such irrelevent 
factors as sex of teacher, subjects she teaches, and marital status. Some 
have felt that student teachers cannot use the benefits of pupil ratings. 
This study concerns a group of public school teachers and student teach- 
ers and how their pupils felt about them. Pupil ratings of teachers were 
examined to see whether or not the aforementioned variables affected 
pupils’ feelings toward their teachers. 


Techniques 


Considerable research has been applied to the problem of determin- 
ing the personality traits needed for successful teaching (4, 6, 7, 9). 
Based upon this prior work, a check list was constructed containing 16 
items on sense of humor, tact, fairness, sympathy, etc.* The items were 
rated by the pupil on a five point scale ranging from favorable to un- 
favorable. 

Each teacher was given a rating computed by adding all her rating 
sheets and dividing by the number of raters. An example may indicate 
the nature of this operation: 

Teach X is rated by three pupils. The circled numbers on the check 
list are summed (e.g.: Courtesy—3, Liking—2, etc.), to give a score for 
each pupil: e.g., John gives a score of 30, Mary a score of 16, and Bill 
gives a score of 24. The sum of these scores, 70, is divided by 3 (number 
of raters) yielding a rating score of 23.3. A trial run was made by giving 
the check list to the 550 seventh and eighth grade pupils of 17 teachers. 
This trial showed that the list took under 20 minutes to administer, that 
it was readable, free from special problems, and internally consistent. 


* The author will be glad to send copies of the checklist to those interested. 


James G. Cooper is supervisor-psychologist in the Modoc County schools, Alturas, 
California. He had formerly taught psychology at San Francisco State College. His 
Ed.D. degree was granted at Stanford University in 1949. The present article is based 
in part on his dissertation. 
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The latter was determined by computing tetrachoric ccrrelation co- 
efficients between each item and the total score. The coefficients ranged 
from .63 (self control) to .88 (enthusiasm) with a median r of .78. 


The next step was that of securing ratings on a large number of 
teachers. This proved to be a frustrating experience. The entire faculty 
of the first secondary school reached voted full cooperation, but this 
excellent beginning was not repeated. Although many teacher groups were 
approached, only a few teachers, if any, agreed to participate in the study. 
Adverse criticisms were many, one teacher epitomized the prevalent feel- 
ings when she said, “They (the pupils) say bad enough things without 
giving them this to think about!” Over three months of elaborate nego- 
tiations produced only 72 teachers. 


To augment this limited number, schools of education were asked to 
join in the study. Favorable action by nine such schools added 153 stu- 
dent teachers. The total sample was limited to junior and senior high 
school teachers in the areas of mathematics, social studies, English, 
foreign language, and science. The curtailment in subjects taught was 
done in order to facilitate a subsequent Rorschach study made on a 
selected portion of the teacher sample (5). 


The mean age of the regular teachers, 37.6 years, was higher than 
that of the student teachers, 26.3 years. Within both groups, the men 
were somewhat (3 years for student teachers, 4 years for regular teach- 
ers) older than the women. 


To summarize, the sample included 72 regular teachers and their 3401 
pupils, and 153 student teachers and their 4730 pupils. Both urban and 
rural areas in California were represented. The sample probably was not 
representative of the total teacher population because participation in the 
study was partially on a voluntary basis. It seems reasonable to believe 
that, in general, teachers most secure in their pupil relationships would 
be more inclined to cooperate than those less secure. This would result 
in a curtailed distribution weighted with the better-liked teachers. 


Analysis of Pupil Ratings 


The regular teachers ranged from 20.9 (favorable end of scale) to 
43.9 (unfavorable score) and student teachers ranged from 17.9 to 52.4. 
The distributions for both groups showed a moderate skew to the right, 
indicating that the teachers tended to cluster at the favorable end of the 
scale. Table I gives the ratings obtained by the two teacher groups and 
compares various sub-groups. 


Table I indicates that the regular teachers’ mean of 31.9 was signi- 
ficantly higher than the student teacher’s mean of 29.0. These, and the 
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TABLE | 


COMPARISONS BETWEEN PUPIL RATINGS OF 
STUDENT TEACHERS AND REGULAR TEACHERS 





Group N Mean S. D. t Ratio 

TURMRINS RUROINI oii ons ch we emeemanewuae 72 31.9 6.08 3.24* 
| ae a ee ape 153 29.0 6.68 
Female regular teachers ~-.---------------- 38 32.2 6.12 1.1 
Male regular teachers ................<.... 34 31.1 5.58 
Female student teachers ~------------------ 53 29.3 7.56 53 
Peele atudlent Webehers: o..snsecunun asec... 95 28.7 5.59 
Student teachers 

ON ih aa recs e 31 27.4 

eetvibd, Bi GMNNIOD: 6 occ occcsnscdcsc cous 31 28.4 


Maniled, wits AMR sien oiaecse cic ncas 31 28.7 


* Significant at 1%. 





other data presented in the table, suggest the following: 


1. Student teachers were liked by their pupils somewhat better than were 
regular teachers. 


2. Male teachers of both groups were favored over female teachers, but the 
differences were not statistically significant. 


3. Among student teachers, there were no significant differences between those 
who were single; married, but no children; and married, with children. 


Effects of Teacher’s Subject on Pupil Ratings 


The ratings of student teachers were analyzed according to the subject 
taught by the teacher. The mean rating for each subject-field is shown 
in Table II. The table shows that the highest (and thereby poorest) rating 
was obtained by the 31 science student teachers. The lowest (and most 
favorable) mean rating was secured by the 13 student teachers of foreign 
languages. 


TABLE Il 


PUPIL RATINGS OF STUDENT TEACHERS 
ACCORDING TO SUBJECT TAUGHT 


Subject Taught N Mean S.D. 


NIN iis metre baa decanonialaa wank waleianne mace 31 31.3 6.31 
HNN kenitecncd ok niecadnonatecmsenaseedbanadetia 31 30.0 7.22 
IEE SRMOD. iis cnniiecnmmncnnwabudokeatakmamauees 62 28.1 3.40 
I a entice aici ici aceite ainabibouiacuaeabmadica 15 27.3 4.85 


CRON SRI ioe clncciini me cdwanmuenwnanmnaminuam 13 26.5 9.38 
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Of particular interest in Table II is the relatively low standard devia- 
tion of 3.4 for the social studies student teachers. This indicates that 
the group was highly homogeneous when compared with the other groups. 
The foreign language student teachers had the most favorable mean, how- 
ever, its large sigma of 9.38 implies that the group included wide ex- 
tremes of both liked and disliked teachers. 


The differences between pupil ratings of student teachers of the five 
subject matter groups shown in Table II are highlighted when each group 
is compared with each other group. The results of these comparisons are 
given in Table III. 


TABLE Ill 
COMPARISONS BETWEEN PUPIL RATINGS AND 
SUBJECT TAUGHT BY STUDENT TEACHER 








~ Difference 
In Means t¢ Ratio 





Social Studies vs. Science 

Social Studies vs. 

Social Studies vs. Foreign Language 

Social Studies vs. Mathematics 

Science vs. 

Science vs. Foreign Language 

Science vs. Mathematics 

English vs. Mathematics 

English vs. Foreign Language 

Mathematics vs. Foreign Language -..--.---....--.----------__ d .26 


* Significant at 2%. ** Significant at 5%. 


Among the ten comparisons in Table III, only two reach statistical 
significance, those between both mathematics and social studies student 
teachers when compared with student teachers of science. These data can 
be expressed a little differently; when social studies student teachers and 
their peers in science are rated by their pupils, the social studies teachers 
receive the more favorable ratings. Similarly, mathematics teachers tend 
to receive pupil ratings that are more favorable than the ratings given to 
science teachers. 


The data presented in Table III permit still another interpretation, 
which is, “When pupils rate their teachers, the ratings are very little 
affected by the subject taught by the teacher.” This conclusion, although 
apparently negated by the two significant preferences (social studies teach- 
ers over science teachers, and mathematics teachers over science teachers) , 
was reached by considering additional possibilities. Table III contains 10 
different comparisons. It is probable that even though no differences were 
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present, one or two comparisons might turn up as being significant. This 
phenomonen can be partially controlled by holding to higher levels of 
statistical significance. In the present example, it is noteworthy that no 
comparisons were significant at or beyond the 1% level. This conclusion 
could be verified by drawing additional samples of science, social studies 
and mathematics teachers and examining the differences between these 
groups. If this were done, it should not be surprising to find that the 
differences shown in Table III would disappear, or even be reversed. 


Summary 


A rating scale of 16 items was given to 3401 pupils of 72 public 
school teachers and to the 4730 pupils of 153 student teachers. It was 
found that student teachers were more favorably rated than were regular 
teachers, the difference being small, but statistically significant. Pupil 
ratings were not affected by the teacher’s sex nor by marital status. In 
general, the pupils did not favor one subject matter over another, although 
there occurred two questionable exceptions. 

The findings from this study give strong support to the position that 
pupil ratings are a valid and reliable estimate of teaching adequacy. It 
was shown that extraneous matters, such as teacher’s sex, etc., do not 
markedly affect a pupil’s judgment when he rates his teacher. Apparently, 
the pupil’s rating is determined almost solely by the teacher’s personality. 
Thus, in order to see ourselves as others see us, all we need do is ask our 
pupils, 
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Evaluation of Administrative Services 


Wituram F. McCiintock 
Claremont Graduate School 


A GROUP of elementary school principals of the San Diego City Schools 
sought a plan through which needs for security and participation of their 
staffs in curriculum planning might be satisfied. They worked on the 
assumption that, if teachers were encouraged to participate in evaluating 
administrative services, these needs might be met. They hoped that through 
such enterprise the teaching staffs might discover that effective administra- 
tion goes beyond the traditional concept which emphasizes plant manage- 
ment; that the leadership function is one in which everyone should share. 


Technique for Encouraging Staff Participation 
in the Leadership Function 


An evaluation form was constructed by the principals with the aid of 
members of the teaching staffs. The form included items on services of 
the principal. 

In three schools the teachers were asked to appraise the efficacy of the 
services in their schools and to offer suggestions for improvement. Teach- 
ers were asked to rate the effectiveness of each item as: (1) “superior,” 
(2) “competent,” and (3) “needing improvement.” 

The major areas of emphasis, as well as samples of the items that were 
included, are as follows: 


CHECK LIST FOR EVALUATION OF ADMINISTRATION 
1 @g 

Effectiveness of Staff Relations 

1. Impartiality and fairness in staff relationships . 

2. Proper respect and recognition of individual initiative . 
Effectiveness of Instructional Program 

1. Assistance in planning and evaluating classroom program . 

2. Adequacy of constructive ideas and suggestions . 


William F. McClintock is an elementary school principal in the San Diego 
Unified School District. He has been in elementary administration since 1941, and 
was a teacher prior to that time. Mr. McClintock attended the Claremont Graduate 
School and completed his Master’s degree in 1949. The present article is a digest of 
his Master’s thesis. 
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Effectiveness of School Organization 
1. Meeting of supply needs . ‘ — 
2. Assignment of teacher responsibilities “ 
Effectiveness of Pupil Relations 
1. Student leadership activities 
2. Rapport with pupils 
Effectiveness of Public Relations 
1. Explanation of school policies, procedures, and teaching prac- 
tices to school community .. . di 
2. Assistance in arranging parent conferences ‘and home contacts Oo 


List below Comments and Suggestions. 
(Please be specific about any checks placed in column three) 


January was selected as the month to initiate the use of the form. This 
gave ample time to work on a program of good human relationships in 
the preceding months, to establish community of thought as to the pur- 
pose of using the form, and to work on the improvement of any weak- 
nesses indicated in the remaining months of the spring term. 


At the first faculty meeting in January the principal explained the 
services he was attempting to provide. Each teacher was given a copy of 
the evaluation form, invited to study it carefully, and record his ratings. 
The completed form was given to one of the teachers who volunteered to 
compile the information into a composite evaluation and present the re- 
sults at the next faculty meeting. It was stressed by the principal that he 
had no desire to see the individual forms, only the composite picture. 


At the next meeting, the faculty member presented the composite 
evaluation, pointing out areas which seemed to him to warrant improve- 
ment in terms of the completed forms. The principal thanked the staff 
and stated that he would study the results further and work toward 
improvement. He also stated that the staff would have another opportunity 
to evaluate progress later in the school year. 


In one of the schools the principal met with his Policies Committee, 
a small group of teachers representing the various grade levels, for the 
purpose of determining the areas of administrative services which seemed 
to need first attention. This report was presented by the Committee at 
the next faculty meeting, and volunteers were requested to offer further 
suggestions and act as observers during the next four-month period to 
ascertain whether progress was being made. 


In May, the principal distributed a shorter evaluation form covering 
the areas which had been designated as needing improvement. Each 
teacher was asked to indicate whether improvement had been noted. The 
results of this second evaluation were brought to a faculty meeting under 
the direction of the teacher who had made the original evaluation, and 
the staff discussed the results. 
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Outcomes 


The results of the successive evaluations varied in the three schools 
but some findings were common in all of them. 


1. Where “little improvement” was noted, it seemed that the princi- 
pal had carried out his improvement program without staff parti- 
cipation. Apparently the teachers felt that there was improvement 
only when they were active participants in the activities which the 
principal initiated to bring about improvement. In one school, for 
example, half the teachers felt that no improvement had been made 
in the item, “explanation of what is expected of you as a faculty 
member.” In the explanation by the principal of the efforts made 
to improve, he indicated that the major enterprise was the prepara- 
tion of a handbook for teachers in which policies, requirements, 
and philosophy were included. He stated that he had done the 
major part of this work, rather than including the staff in the 
project. In another school all of the teachers felt that improvement 
had been made in the item, “availability in the building.” The 
principal had worked with his Policies Committee in preparing a 
plan for scheduling conferences and informing the staff of out-of- 
school obligations. It was put into action by this group. The prin- 
cipal checked daily with the secretary to make sure that no teacher 
had been unintentionally prevented from seeing him. 


Although a total of sixty check marks were placed in the improve- 
ment column at the time of the first evaluation, only thirty-nine 
comments were made, despite specific requests to do so. There was 
at that time a feeling of uncertainty and unwillingness on the part 
of the teachers to make statements about the services of their 
administrator, even though both instructions seemed adequate and 
the ratings were anonymous. 


In the first evaluation a total of forty-three comments was made, of 
which twenty-six were in the section on effectiveness of staff rela- 
tions. The teachers evidently felt, as did the principals, that this 
was a most important area in which the services should be “com- 
petent” or better. 


There was agreement among the principals that the form should 
not be used in consecutive years except with new teachers. Each 
principal felt that it was up to him to carry forward from the point 
of the second improvement, offering opportunities for personal con- 
ferences, for policies committee decisions, and other avenues 
through which the staff might discuss the increasing or decreasing 
effectiveness of the services being offered. 
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5. The principals found that they had developed previously an incor- 
rect picture of their faculties in that some of the projects the prin- 
cipals had considered as acceptable to the staff were not so con- 
sidered by the staff. As an example, in the early fall a principal 
had established a faculty Policies Committee to help in the school 
operations. He asked several teachers to serve on the Committee, 
hoping to avoid asking teachers to volunteer under pressure if the 
request was made in a faculty meeting. It was not until the evalua- 
tion session in January that he discovered that faculty members 
resented his appointments, felt that the committee was not demo- 
cratically chosen and as a result was not democratic in action. 
The unrest grew steadily through January, but through use of the 
anonymous evaluation, was checked before it developed into a 
serious morale problem. 


There were therapeutic values for the principals. This cooperative 
plan of evaluation of their leadership enabled them to discover 
many of the sources of resistance on their part to the use of such 
a democratic process. It required considerable effort for one to face 
the various resentments of the staff and remain objective. Suppose 
the results showed that all his services were unacceptable? Facing 
the group the first time was often embarrassing. The principal felt 
some comments to be unjustified, and he had to try to suppress a 
desire to rise in righteous defense. During the study he felt im- 
patient with the group in some cases where the process seemed to 
be taking the problem of improving the school away from him. 
At other times the staff seemed to move so slowly that the principal 
wondered if he would have to make the suggestions himself. Having 
experienced these varied feelings, the principal usually was able to 
control his emotions and overcome his timidity as he realized that 
it was as difficult for the staff members to make their suggestions 
honestly and objectively as it was for him to receive them. The 
process became easier for both principal and faculty as the study 
moved along toward its objective. 


Evaluation of This Study 


This study in the evaluation of administration: 


1. Satisfied the need for security in many staff members by: 


a. affording the teachers the opportunity to gain insight concern- 
ing the principal’s services. The principal reviewed each section 
of the form with the teachers in advance of their use of it. 
The teachers were thus able to see the scope and functions of 
the principal in relation to his total assignment. 
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b. enabling the staff to learn about the principal’s philosophy of 
administration and to see by his actions that he wished to be 
democratic and was eager to improve. 


helping the teachers see that the principal was not only willing 
to accept suggestions about his services, but also to do some- 
thing about them. 

involving the entire faculty in a common project. The principal 
helped each individual feel that his contribution was worth- 
while, thus making him aware that he belonged to the group. 
It also helped each teacher to analyze his own ideas in relation 
to what others were thinking. 


2. Satisfied the need for participation by giving all faculty members 
the opportunity to share their thoughts anonymously and become a 
part of a total project in which results were tangible, meaningful, 
and openly discussed. 


Conclusions 


The rewards both to the staff and to the principal are many when the 
democratic process in curriculum planning goes beyond the thought-stage 
to become an action-program. One of the guiding principles of such a 
program is that of constant evaluation by those who are participating. 

From a first successful use of this evaluation of administrative serv- 
ices, both principal and teaching staff can grow in their mutual under- 
standing and desire to work for better educational experiences for school 
children. Feelings of reservation on the part of principal or staff need not 
exist in the future if the principal capitalizes on this avenue for establish- 
ing sound human relationships and works to maintain them in an evolving 
informal atmosphere where staff members feel free at any time to react 
to the curricular and administrative problems of the school. 


Having the challenging title, “What Do We Know About Our Schools?,” 
the National Citizens Commission for the Public Schools has recently 
published a booklet which contains a collection of questions relative to the 
public schools. The questions were compiled by 200 persons including 
superintendents, teachers, school board members, leaders of citizens com- 
mittees, and representatives of many national organizations interested in 
the public schools. A copy of the publication may be secured by writing 
to the Commission’s headquarters at 2 West 45th Street, New York 19, 
New York. 
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